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Abstract: A notion of entangled Markov chain was introduced by Accardi 
and Fidaleo in the context of quantum random walk. They proved that, in the 
finite dimensional case, the corresponding states have vanishing entropy density, 
but they did not prove that they are entangled. 

In the present note this entropy result is extended to the infinite dimensional 
case under the assumption of finite speed of hopping. 

Then the entanglement problem is discussed for spin 1/2, entangled Markov 
chains generated by a binary symmetric channel with hopping probability 1 — q. 
The von Neumann entropy of these states, restricted on a sublattice is explicitly 
calculated and shown to be independent of the size of the sublattice. This is a 
new, purely quantum, phenomenon. 

Finally the entanglement property between the sublattices -A({0, 1, . . . , N}) 
and A({N + 1}) is investigated using the PPT criterium. It turns out that, 
for q 7^ 0,1,^ the states are non separable, thus truly entangled, while for 
q = Q, 1, i, they are separable. 



1 Introduction 

Motivated by recent developments in quantum information theory, Accardi and 
Fidaleo introduced a Markov chain, called "entangled" , and including a quan- 
tum version of classical random walks [1] . They consider a quantum spin chain 
and impose the following conditions on its state. 

(i) It should be a quantum Markov chain [2] . 

(ii) It should be purely generated [3]. 

(iii) Its restriction on at least one maximal Abelian subalgebra, should be a 
classical random walk. 

(iv) It should be uniquely determined, up to arbitrary phases, by its classical 
restriction. 

In order to fix the notations, let us briefly review their definition. 
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A one-sided (or two sided) infinite quantum spin chain is defined by a 1- 
dimensional lattice, which in our case will be N (or Z). On each site of the 
lattice there is a spin degree of freedom. 

Its observables are represented by the algebra B(W), of all the bounded 
operators on some separable Hilbert space H. Typically (but not for random 
walks) its dimension is finite (say d < oo). In this case B(7i) is a d x d matrix 
algebra, A({x}) ~ M d (C)(x <G N (or Z)). For each finite region A in N (or Z), 
algebra of observables with respect to A is defined by -4(A) := ® X £aA({x}). 
The total algebra of observables is defined as the closure of their union, 



A:=U A A(Ay ", 

where the closure is taken with respect to norm topology. 

On this chain we consider a class of states defined as follows. First we will 
consider the case of one-sided chain (defined on N) . Then the state is extended 
to the two-sided chain by imposing translation invariancc. 

To define an entangled Markov state [1], we begin with its finite volume 
version. Suppose there exist a probability distribution {P(i)}ien on a set fl 
whose cardinality is same as the dimension of H, and a transition probability 
{P(i — > j)}(i.j)enxQ from ft to itself. We define a vector in Ji ® "H ® ■ ■ ■ ® Ti 
(N + 1-times) by 

l*Jv) := ^2 V P(io)P(io -» h)P{h -> ii) ■ ■ ■ P(in-i -» «jv)|«o«i ■ ■ ■ ijv), 

where {\i}} is an orthonormal basis in H and \ioh • • • ijv) '■— |«o)®|*i)® - ■ • ( X>|*A r )- 
It is easily checked that the norm of this vector is 1 and therefore it defines a 
state over A({0, 1, . . . , N}) by 

wjv(-) := (*jv| • |*iv>- 

Accardi and Fidaleo has shown that the infinite volume limit 

uj(-) := lim ujn(-), 

exists and defines a state on A which is a quantum Markov chain in the sense 
of [2]. The states in this class of quantum Markov chains are called entangled 
Markov states. In the infinite dimensional case (dim7i = oo) a sub-class of these 
entangled states can be regarded as a quantum version of the classical random 
walks. The finite dimensional case (H = C d ) is also interesting in the context 
of statistical mechanics of spin chains. 

In this note we estimate the entropy density of such states when the dimen- 
sion of H is infinite. 

In the case d = 2 and under the assumption that its generating classical 
transition probability is symmetric and stationary, we explicitly compute the 
entropy of finite sub-lattices. Finally its entanglement property is examined. 
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2 Entropy Density 



In this section we consider a one-sided spin chain and entangled Markov states 
over it. To estimate entropy of a finite sublattice, we compute the restriction 
of the chain on *4({0, 1, . . . , N}). It is easy to verify that the coefficients, in the 
given basis, of the density matrix of the chain, localized on {0,1,..., N}, are: 

(pN)i oil ... iN ,j j 1 -j N : = w (l*o*i ' ■ -iN){joji ■ ■ -3n\ ® 1) 
= y/P(io)P(io ^ n)P{n h) ■ ■ ■ P{t N -i ^ t N )P(t N i) 
y/P(jo)P(jo ^ Ji Wi ^ h) ■ ■ ■ PUn-i ^ 3n)P{jn ^ i). 
The following theorem is easy to prove. 

Theorem 1 The restriction of an entangled Markov state on the Abelian sub- 
algebra M., generated by the matrices which are diagonal in the given basis, 
gives a classical Markov chain. If such a classical chain is stationary (i.e., if 
P(i)P(i — > j) = P(j) is satisfied for each j) its Shannon entropy density is 
(see e.g. [5]) - £. P(i) £ P(» - j) logP(* - j). 

To estimate the von Neumann entropy of the density matrix pn, the following 
lemma is crucial. 

Lemma 2 For an arbitrary N £ N and for any A £ A({0, 1, . . . , A^}), 

= (* Ar+1 |,4|* Ar + 1 ) 

holds. That is, for strictly local operator, taking into account one additional site 
is sufficient. 

Proof: For sufficiently large M, m\A\^ m) can be expressed as 
(^m\A\^ m ) 

= Y V P(io)P(io -» h)P(ii -» 12) ■ ■ ■ P(iN-i -» ijv)-P(«iv -» ijv+i) 

y/P(jo)P(jo ^ ^ J2) • • • P(jiv-i ^ Jjv)P0'jv ^ ijv+i) 

f (ijv+i — » jjv+2) • • • P{im-i — > iM)(iaii • • • iN\A\joji ■ ■ • jiv)- 

Thanks to ^\ P{h-i — ► «;) = 1, it docs not depend on M as soon as M > 
N + l. ' Q.E.D. 

Thus the following theorem holds. 

Theorem 3 Suppose the dimension d of Hilbert space 7i is finite. For any 
N £ N, von Neumann entropy of pn satisfies 

S v n(pn) ■= -tr(p N \ogp N ) < \ogd. 
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Proof: The previous lemma means that 

Pn = trjv+i (|*jv+l)(*JV+l|) 

holds. If we put <tn+i '■— tro,i,...,jv (| VE* a^+i) ("I'Ar+i |) , according to Schmidt de- 
composition theorem[6], the purity of |4 , at +1 ) (^jv+iI implies that the eigenval- 
ues of coincide with ones of &n+i, an d 

S v n(pn) = S v n((Tn+i) 

holds. Since ctat+i is a state on C d , its von Neumann entropy is bounded from 
above by logrf. Thus we can conclude that for any N, 

S v n(pn) < logd 

holds. Q.E.D. 
This allows to simplify the proof of the following result, obtained in [1]. 

Proposition 4 For finite d, any entangled Markov state has vanishing mean 
von Neumann entropy. 

Remark 5 It is known [3] that the vanishing of the mean entropy is not equiv- 
alent to the purity of the state. For instance in the case d = 2, P(0) = P(l) = 1 
and P(0 — > 0) = P(l — > 1) = 1, the resulting state is an equal mixture of the 
two pure states, |000 •••)(••• 000| and |111 •••)(••• 111|. 

For the infinite dimensional case we obtain the following result. Consider the 
case fi = Z, which includes a quantum version of the classical random walks on 
a lattice. 

Theorem 3 cannot be directly applied and in fact even for single site its 
von Neumann entropy can be infinite [4]. We, however, are interested in the 
case when initially the distribution is localized and it gradually expands to 
its neighbours. That is, typically the initial distribution P(-) has a compact 
support, say A C Z. Moreover, the speed of hopping should be finite. That is, 
there exists V < oo such that for all i G Z, 

max{|c| : P(i -» i + c) ^ 0} < V 

holds. Under these conditions, the following theorem holds. 

Theorem 6 For localized initial distributions and finite hopping range V , the 
von Neumann entropy of pn is bounded from above as follows: 

S vN (p N )<log(\A\+2V(N + l)). 
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Proof: The range of summation for 



|*iv+i) := ^ \JP{io)P{io —> ii)P(h —> 12) ■ ■ ■ P{in -* iiv+i)|«o, h, ■ ■ ■ ,ijv+i), 

can be finite. As in the theorem 3, density operators tr7v +1 |^I , jv+i)(^ / A r +i| and 
tro,i,...,Jv(|^ , JV+i)(^'jv+i|) show the same value of von Neumann entropy. Since 

tro,i,...,Ar(|*Jv+i><*Jv+i|) = EE E # ^) 

IN + l jN + l IN 

\JP{i N -» lN+l)\/P{iN -» jjv+i)Kjv+i)0'jv+i|, (1) 
holds, where P{in) is defined as 

P(i w ) := J2 P(*o)P(i - -> i 2 ) ■ ■ ■ - *jv). 

The summation for i^+i and Jjv+i in (1) runs over finite range whose cardinality 
is bounded by |A| + 2V(N + 1). Q.E.D. 
Thus we obtain the following. 

Theorem 7 The von Neumann entropy density of an entangled Markov chain, 
with localized initial distributions and finite hopping range V, vanishes. 



3 d = 2: Symmetric case 

In this section we analyze the simplest example of entangled Markov state, 
namely the case d — 2 with symmetric transition probability. That is, the state 
is generated by a channel: 

P(0 -> 0) = q 
P(l->1) = ?, 

where < q < 1 holds. We, in addition, assume stationarity and thus for 
«Z 9*0,1, 

P(0) = P(1) = 1 (2) 

must hold. For simplicity, also for q = 0, 1, we assume (2) holds. In this case 
Lemma 2 enables us to diagonalize the state pn for arbitrary N as shown by 
the following theorem. 

Theorem 8 For q ^ \, there are only two nonvanishing eigenvalues for px, 
and they are 

A+ := \ + y/q(l - q) 
A- := \-^qO~T). 
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Their corresponding eigenvectors are respectively, 

- . 1 e (^) E " i<, "' 9, " ) (^)"-s:=.'— > 

w/iere © means summation with mod 2 (XOR operation). (0 is its eigenvalue 
with 2 N+1 — 2 multiplicity.) For q — i, p^ is a pure state over A({0, 1, . . . , iV}). 

Proof: By lemma 2, is equal to pn = trjv+il^jv+iX^JV+il- This fact and 
Schmidt decomposition theorem [6] shows that |^jv+i) can be expressed as 

l*iv+i) =^Tx/T l \¥ N )®\e l ), 
I 

where A; (I = ±) are the common eigenvalues of pn and o-^+i '■= tri^ ivl^jv+i) (^iv+il 

and {|e;)}'s are the eigenvectors of ctjv+i- Thus to obtain A; and \^ l N ), we should 
first diagonalize the 2x2 matrix ctn+i which can be easily computed to be: 

a N+1 = \ (|0)(0| + |1)(1|) + v^T^) (|0)<1| + |1)(0|) . 
Its eigenvalues are 



A± = - ± ^Jq(l - q) 
and the corresponding eigenvectors are 

|e±) :=-J=(|0)±|l)). 

The vectors V^il^w) ® l e ±) are obtained by applying 1 ® |e±)(e±| to |^jv+i)- 
This gives: 

|*£> = = 51 y/P(io)P(io^h)---P(iN-iiN) 

\l\± y/q(l - q) »o-*iv 

^ (VP(ijv = To) ± V-P(ijv -» 1)) |«o- ■ -*jv>, 
which is directly deformed into the desired form. 

In case of q — |, one of the above eigenvalues A_ vanishes and pjv is shown to 
be pure. Q.E.D. 
In view of the above theorem and the Schmidt decomposition theorem[6], the 
following theorem is obvious. 
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Theorem 9 For q=^\, von Neumann entropy of pn for any N £ N is 



S vN {pn) = S vN (a N+ i) = - y- + y/q[l - q)j log ^- + ^ q(l - q)J 

Q - v/io^y) log Q - v^o^y) • 

For a = |, S v n(pn) — /or any iV e N. 

Remark 10 7t is not difficult to verify that the above technique can be used for 
a general (non symmetric) channel with d = 2. 

Now we investigate the entanglement property of the states. Let us consider an 
entangled Markov state generated by a symmetric channel and its restriction to 
sublattice -4({0, 1, . . . , N, N + 1}) which is written as Pn+i m a density matrix. 
If we divide the sublattice .4({0, 1, . . . , N, N + 1}) into A({0, 1, . . . , N}) and 
A({N + 1}), is the state pn+i separable or entangled between them? The 
following theorem gives the answer. 

Theorem 11 For q ^ 0,1,^, the above defined Pn+i is entangled (i.e., in- 
separable) between -4({0, 1, . . . , N}) and A({N + 1}). For 9 = 0,1,^, pn+i is 
separable. 

Proof: Let us consider the two dimensional subspace spanned by |*^) and 
I^jv)- and its (normalized but not orthogonal) basis: 

|<M0)) := v/a7|*+) + a/aT|*^) 

= ^2 V p (io ii)P(h -* h) ■ ■ ■ P{iN —> 0)|*o*i ■ ■ - ijv) 

io---iN 



\$ N (i)) := v^7i*+) - yxri^) 

= V P(io —> h)P(ii — > «2) • • • P(i>N — » l)|«o*i ■ ■ - in)- 

io---iN 

It is easy to see that the following relations hold, 

($jv(0)|$jv(0)) = <#jv(1)|#jv(1)> = 1 
<*jv(0)|*jv(1)> = A+-A_. 

The expansion of in this basis is: 

= (>/9± v/l^) (l*Jv(0)) ® |0) ± |^(1)) ® |1)) . 
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Therefore the density matrix pn+i can be written as 
PN+1 = A + |*+ +1 )(*+ +1 | + A_|*^ +1 )(^ +1 | 

= \ (|*iv(0))($jv(0)| ® |0)(0| + |^ jv (1)><^7nt(1)| ® |1)(1|) 

(|$iv(0))($iv(l)| ® |0)(1| + |<M1)X<M0)| ® |1)(0|) 

Since it is can be identified with a matrix in C 2 ® C 2 , the PPT (positive partial 
transpose) criterion of [7, 8] can be used to check its separability [9]. According 
to this criterion pn+i is separable if and only if the partially transposed matrix 

PnIi ■■= ^(|$ JV (0))<$ JV (0)|®|0)<0| + |$ JV (1)X$ JV (1)|®|1)<1|) 

(|$iv(0))($iv(l)| ® |1>(0| + |<M1)X<M0)| ® |0)(1|) . 

is still positive. Let us prove that, in the present case, p^ + i is not positive in 
general. In fact, computing (<^|p^+i|<^) where tp is the normalized vector: 

\ V ) :=±={\$> N {1))®\Q)-\$> N {Q))®\1)) 



gives 



which is negative when q ^ 0,1,^. Thus we can conclude that pn+i is an 
entangled state between A{{0, 1, . . . , N}) and A({N + 1}). 
For q = i, by the previous lemma it is easily seen that pn+i is just a product 
state of pure states. 

For q — 1, a straightforward calculation shows that pn+i has the form, 
Pn+i = | (|00- - -00><00- • -00| + |11 • - - 11><11 - - ■ 11|) 

which is obviously separable. 

For q = 0, pn+i can be written as, 

PN+1 = |(|01---01><01---01| + |10---10><10---10|) 
(here we assumed TV is odd). It also is obviously separable. Q.E.D. 
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